Apparatus and associated methods for display of virtual reality content

ABSTRACT

An apparatus configured: based on a point of interest identified in one or more instances of virtual reality content comprising at least visual imagery and data to provide a virtual reality space in which the visual imagery is displayed; and based on context information for at least one of the instances of the virtual reality content, the context information defining the extent of a virtual sub-volume of the virtual reality space that includes the point of interest; to provide for display of a virtual-reality-content-review-space to a user comprising a space in which a VR preview of the instances of virtual reality content is displayed at a location spaced from a point of view of the user, the or each VR preview comprising the respective sub-volume defined by the context information for providing the user with an understanding of the virtual reality space around the point of interest.

RELATED APPLICATION

This application was originally filed as PCT Application No.PCT/FI2018/050413, filed on May 31, 2018, which claims priority from EPApplication No. 17178581.9, filed on Jun. 29, 2017.

TECHNICAL FIELD

The present disclosure relates to the field of virtual reality, inparticular, to the display, for selection, of instances of virtualreality content. It also relates to associated methods, computerprograms and apparatus.

BACKGROUND

The availability of virtual reality content is increasing. The virtualreality content may be of various objects and places, be of differentgenres or relate to different topics. The effective browsing and/orselection of virtual reality content for a user to experience from aplurality of instances of virtual reality content options may bechallenging.

The listing or discussion of a prior-published document or anybackground in this specification should not necessarily be taken as anacknowledgement that the document or background is part of the state ofthe art or is common general knowledge. One or more aspects/examples ofthe present disclosure may or may not address one or more of thebackground issues.

SUMMARY

In a first example aspect there is provided an apparatus comprising:

-   -   at least one processor; and    -   at least one memory including computer program code,    -   the at least one memory and the computer program code configured        to, with the at least one processor, cause the apparatus to        perform at least the following:    -   based on a point of interest being identified in one or more        instances of virtual reality content, the one or more instances        of virtual reality content each comprising at least visual        imagery and data to provide a virtual reality space in which the        visual imagery is displayed; and based on context information        for at least one instance of the virtual reality content, the        context information defining the extent of a virtual sub-volume        of the virtual reality space that includes the point of        interest;    -   provide for display of a virtual-reality-content-review-space to        a user, the virtual-reality-content-review-space comprising a        virtual space in which a virtual reality preview of the one or        more instances of virtual reality content is displayed at a        location spaced from a point of view of the user, the or each        virtual reality preview comprising the respective sub-volume        defined by the context information for providing the user with a        view of the virtual reality space around the point of interest.

In one or more examples, the virtual reality previews provide the userwith a view that allows for understanding of the virtual reality spacearound the point of interest. In one or more examples, thevirtual-reality-content-review-space is provided for display in one ofvirtual reality and augmented reality. Thus, the virtual realitypreviews may be presented overlaid over a view of the real world inaugmented reality, or the virtual reality previews may be presented in avirtual-reality-content-review-space in virtual reality.

In one or more embodiments, the sub-volume comprises an amount of thevirtual reality space of each instance of virtual reality content todistinguish surroundings of the point of interest in the sub-volume fromsurroundings of the point of interest in the sub-volume of any other ofthe one or more instances of virtual reality content.

In one or more examples, the context information is configured to definethe sub-volume such that it includes at least one feature in the visualimagery of the virtual reality content at a virtual location around saidpoint of interest to provide an indication of the virtual surroundingsof the point of interest.

In one or more examples, the virtual reality content is six degrees offreedom (6DoF) content.

In one or more examples, the context information defines one or more of:

-   -   i) dimensions of the sub-volume that includes the point of        interest;    -   ii) a virtual distance from the point of interest to a feature        in visual imagery of the instance of virtual reality content,        the virtual distance relative to the point of interest providing        for definition of the sub-volume;    -   ii) an identifier of at least one feature in the visual imagery        of the instance of virtual reality content, wherein the        sub-volume includes the point of interest and the identified        feature.

In one or more embodiments, the context information is one or more of:

-   -   i) predefined and associated with the virtual reality content,        the context information providing information to define the        sub-volume associated with one or more points of interest that        feature in said virtual reality content;    -   ii) generated from computer content analysis configured to        identify the location of the point of interest in said virtual        reality space of said instance of virtual reality content and        define the sub-volume therearound to provide the user with an        understanding of the virtual reality space around the point of        interest; and    -   iii) generated, at least in part, from user-settings that        specify the size of the sub-volume for the point of interest.

In one or more embodiments, the context information is specific to thepoint of interest and to its surroundings in the respective instance ofvirtual reality content.

In one or more embodiments, the context information defines anassociated nearby feature in the virtual reality content, the sub-volumedefined such that it includes the point of interest and the associatednearby feature, the associated nearby feature comprising a predeterminedfeature in the visual imagery of the instance of virtual reality contentat a virtual location around said point of interest to provide anindication of the virtual surroundings of the point of interest.

In one or more embodiments, the one or more instances of virtual realitycontent comprises search results of a search query, the search queryperformed on a plurality of instances of virtual reality content thatinclude the one or more instances of virtual reality content, the pointof interest comprising the subject of a search query from which saidsearch results were generated.

In one or more examples, the point of interest comprises one or more ofan object, location or occurrence featured in imagery of said virtualreality (VR) content.

In one or more examples, the VR preview comprises the spatial sub-volumeof the whole VR space defined by the instance of VR content and atemporal subset of a period of time covered by the instance of VRcontent.

In one or more examples, the point of interest is provided for displaysubstantially at the centre of the sub-volume.

In one or more embodiments, a plurality of virtual reality previews ofinstances of virtual reality content are provided for display in thevirtual-reality-content-review-space, the virtual reality previews eachdisplayed at a location spaced from a point of view of the user and atleast partially surrounding the point of view of the user.

In one or more embodiments, the relative size of each of the virtualreality previews relative to the other virtual reality previews providedfor display is defined by the size of the virtual sub-volume defined bythe context information for each instance of virtual reality content.

In one or more embodiments, at least two virtual reality previews areprovided for display, a first virtual reality preview and a secondvirtual reality preview and wherein one or more of:

-   -   i) the first virtual reality preview is located to the side of        the second virtual reality preview in the        virtual-reality-content-review-space from the point of view of        the user and the virtual sub-volume of the first virtual reality        preview and virtual sub-volume of the second virtual reality        preview overlap one another;    -   ii) the virtual sub-volume of the first virtual reality preview        and virtual sub-volume of the second virtual reality preview are        non-overlapping;    -   iii) the first virtual reality preview is located in front of        the second virtual reality preview in the        virtual-reality-content-review-space from the point of view of        the user and the first virtual reality preview is displayed with        at least partial transparency to provide for viewing of the        second virtual reality preview through the first virtual reality        preview;    -   iv) the first virtual reality preview is located in front of the        second VR preview in the virtual-reality-content-review-space        from the point of view of the user thereby hiding the second        virtual reality preview from view, wherein based on user-input        the second virtual reality preview is made visible to the user.

In one or more embodiments, based on a user input to move their point ofview in the virtual-reality-content-review-space to a position withinthe sub-volume of a particular one of the virtual reality previews,provide for one or more of:

-   -   i) presentation of at least a temporal sub-section of the        instance of virtual reality content associated with the        particular virtual reality preview, at least a portion of the        temporal section featuring the point of interest;    -   ii) presentation of the instance of virtual reality content        associated with the particular virtual reality preview in        virtual reality;    -   iii) presentation of a larger volume of the virtual reality        space than that defined by the sub-volume;    -   iv) removal from display of the virtual reality previews other        than the particular virtual reality preview.

In one or more embodiments, the one or more virtual reality previewscomprise one or more of:

-   -   i) substantially cuboid-shaped sub-volumes;    -   ii) substantially spherical-shaped sub-volumes; and    -   iii) substantially sectorial-shaped sub-volumes.

In one or more embodiments, the one or more virtual reality previews areprovided for display such that each virtual reality preview comprises awindow through which the sub-volumes are viewed and wherein the virtualreality previews are provided with a substantially fixed orientationrelative to the user and the sub-volumes of virtual reality space andthe point of interest therein are rotated.

In one or more embodiments, the one or more virtual reality previews areprovided for display in one or more of the following configurations:

-   -   i) in a plane surrounding the point of view of the user;    -   ii) in at least two planes, a first of the planes arranged        substantially horizontally and surrounding the point of view of        the user and the second of the planes arranged substantially        horizontally and above or below the point of view of the user,        spaced from the first plane;    -   iii) in a plurality of sectors that converge at the point of        view of the user;    -   iv) in a first tier comprising a plurality of sectors that        converge at the point of view of the user and a second tier        comprising a plurality of sectors arranged in a ring that is        substantially centred at the point of view of the user;    -   v) at spaced points along a spiral that spirals around the point        of view of the user.

In a second aspect there is provided a method, the method comprising

-   -   based on a point of interest being identified in one or more        instances of virtual reality content, the one or more instances        of virtual reality content each comprising at least visual        imagery to provide a virtual reality space in which the visual        imagery is displayed; and based on context information for at        least one instance of the virtual reality content, the context        information defining the extent of a virtual sub-volume of the        virtual reality space that includes the point of interest;    -   providing for display of a virtual-reality-content-review-space        to a user, the virtual-reality-content-review-space comprising a        virtual space in which a virtual reality preview of the at least        one instance of virtual reality content is displayed at a        location spaced from a point of view of the user, the or each        virtual reality preview comprising the respective sub-volume        defined by the context information for providing the user with a        view of the virtual reality space around the point of interest.

In a third aspect there is provided a computer readable mediumcomprising computer program code stored thereon, the computer readablemedium and computer program code being configured to, when run on atleast one processor, perform the method of:

-   -   based on a point of interest being identified in one or more        instances of virtual reality content, the one or more instances        of virtual reality content each comprising at least visual        imagery to provide a virtual reality space in which the visual        imagery is displayed; and based on context information for at        least one instance of the virtual reality content, the context        information defining the extent of a virtual sub-volume of the        virtual reality space that includes the point of interest;    -   providing for display of a virtual-reality-content-review-space        to a user, the virtual-reality-content-review-space comprising a        virtual space in which a virtual reality preview of the at least        one instance of virtual reality content is displayed at a        location spaced from a point of view of the user, the or each        virtual reality preview comprising the respective sub-volume        defined by the context information for providing the user with a        view of the virtual reality space around the point of interest.

In a further aspect there is provided an apparatus, the apparatuscomprising means configured to;

-   -   based on a point of interest being identified in one or more        instances of virtual reality content, the one or more instances        of virtual reality content each comprising at least visual        imagery to provide a virtual reality space in which the visual        imagery is displayed; and based on context information for at        least one instance of the virtual reality content, the context        information defining the extent of a virtual sub-volume of the        virtual reality space that includes the point of interest;    -   provide for display of a virtual-reality-content-review-space to        a user, the virtual-reality-content-review-space comprising a        virtual space in which a virtual reality preview of the at least        one instance of virtual reality content is displayed at a        location spaced from a point of view of the user, the or each        virtual reality preview comprising the respective sub-volume        defined by the context information for providing the user with a        view of the virtual reality space around the point of interest.

The present disclosure includes one or more corresponding aspects,examples or features in isolation or in various combinations whether ornot specifically stated (including claimed) in that combination or inisolation. Corresponding means and corresponding functional units (e.g.,function enabler, AR/VR graphic renderer, display device) for performingone or more of the discussed functions are also within the presentdisclosure.

Corresponding computer programs for implementing one or more of themethods disclosed are also within the present disclosure and encompassedby one or more of the described examples.

The above summary is intended to be merely exemplary and non-limiting.

BRIEF DESCRIPTION OF THE FIGURES

A description is now given, by way of example only, with reference tothe accompanying drawings, in which:

FIG. 1 illustrates an example apparatus for providing for display of aVR-content-review-space to a user;

FIG. 2 shows example instances of VR content featuring the same point ofinterest, a cat;

FIG. 3 shows an example view of a VR-content-review-space illustratingthe user at its centre;

FIG. 4 shows a first and second example of a sub-volume of a VR preview;

FIG. 5 shows a view of a VR-content-review-space with a first and secondexample configuration;

FIG. 6 shows a view of a VR-content-review-space with a third and fourthexample configuration;

FIG. 7 shows a view of a VR-content-review-space with a fifth exampleconfiguration;

FIG. 8 shows a view of a VR-content-review-space with a sixth exampleconfiguration;

FIG. 9 shows a view of a VR-content-review-space with a seventh, spiral,example configuration;

FIG. 10 shows a view of a VR-content-review-space with an eighth exampleconfiguration

FIG. 11 shows a flowchart illustrating an example method; and

FIG. 12 shows a computer readable medium.

DESCRIPTION OF EXAMPLE ASPECTS

Virtual reality (VR) may use a VR display comprising a headset, such asglasses or goggles or virtual retinal display, or one or more displayscreens that surround a user to provide the user with an immersivevirtual experience. A virtual reality apparatus, which may or may notinclude the VR display, may provide for presentation of multimedia VRcontent representative of a virtual reality scene to a user to simulatethe user being present within the virtual reality scene. Accordingly, inone or more examples, the VR apparatus may provide signalling to a VRdisplay for display of the VR content to a user while in one or moreother examples, the VR apparatus may be part of the VR display, e.g.part of the headset. The virtual reality scene may therefore comprisethe VR content displayed within a three-dimensional virtual realityspace so that the user feels immersed in the scene, as if they werethere, and may look around the VR space at the VR content displayedaround them. The virtual reality scene may replicate a real world sceneto simulate the user being physically present at a real world locationor the virtual reality scene may be computer generated or a combinationof computer generated and real world multimedia content. Thus, the VRcontent may be considered to comprise the imagery (e.g. static or videoimagery), audio and/or accompanying data from which a virtual realityscene may be generated for display. The VR apparatus may thereforeprovide the VR scene by generating the virtual, three-dimensional, VRspace in which to display the VR content. The virtual reality scene maybe provided by a panoramic video (such as a panoramic live broadcast),comprising a video having a wide or 360° field of view (or more, such asabove and/or below a horizontally oriented field of view, sometimesknown as 360°×360°). A panoramic video may have a wide field of view inthat it has a spatial extent greater than a field of view of a user orgreater than a field of view with which the panoramic video is intendedto be displayed.

The VR content provided to the user may comprise live or recorded imagesof the real world, captured by a VR content capture device, for example.An example VR content capture device comprises a Nokia Technologies OZOdevice. As the VR scene is typically larger than a portion a user canview with the VR display, the VR apparatus may provide, for display onthe VR display, a virtual reality view of the VR scene to a user, the VRview showing only a spatial portion of the VR content that is viewableat any one time. The VR apparatus may provide for panning around of theVR view in the VR scene based on movement of a user's head and/or eyes.A VR content capture device may be configured to capture VR content fordisplay to one or more users. A VR content capture device may compriseone or more cameras and, optionally, one or more (e.g. directional)microphones configured to capture the surrounding visual and aural scenefrom a capture point of view. In some examples, the VR content capturedevice comprises multiple, physically separate cameras and/ormicrophones. Thus, a musical performance may be captured (and recorded)using a VR content capture device, which may be placed on stage, withthe performers moving around it or from the point of view of an audiencemember. In each case a consumer of the VR content may be able to lookaround using the VR display of the VR apparatus to experience theperformance at the capture location as if they were present.

The virtual reality content may comprise, and a VR apparatus presentingsaid VR content may provide, predefined-viewing-location VR orfree-viewing-location VR. In predefined-viewing-location VR, thelocation of the user in the virtual reality space may be fixed or followa predefined path. Accordingly, a user may be free to change theirviewing direction with respect to the virtual reality imagery providedfor display around them in the virtual reality space, but they may notbe free to arbitrarily change their viewing location in the VR space toexplore the VR space. Thus, the user may experience such VR content froma fixed point of view or viewing location (or a limited number oflocations based on where the VR content capture devices were located inthe scene). In some examples of predefined-viewing-location VR theimagery may be considered to move past them. Inpredefined-viewing-location VR content captured of the real world, theuser may be provided with the point of view of the VR content capturedevice. Predefined-viewing-location VR content may provide the user withthree degrees of freedom in the VR space comprising rotation of theviewing direction around any one of x, y and z axes and may therefore beknown as three degrees of freedom VR (3DoF VR).

In free-viewing-location VR, the VR content and VR apparatus presentingsaid VR content may enable a user to be free to explore the virtualreality space. Thus, the user may be provided with a free point of viewor viewing location in the virtual reality space. Free-viewing-locationVR is also known as six degrees of freedom (6DoF) VR or volumetric VR tothose skilled in the art. Thus, in 6DoF VR the user may be free to lookin different directions around the VR space by modification of theirviewing direction and also free to change their viewing location (theirvirtual location) in the VR space by translation along any one of x, yand z axes. The movement available in a 6DoF virtual reality space maybe divided into two categories: rotational and translational movement(with three degrees of freedom each). Rotational movement enables a userto turn their head to change their viewing direction. The threerotational movements are around x-axis (roll), around y-axis (pitch),and around z-axis (yaw). Translational movement means that the user mayalso change their point of view in the space to view the VR space from adifferent virtual location, i.e., move along the x, y, and z axesaccording to their wishes. The translational movements may be referredto as surge (x), sway (y), and heave (z) using the terms derived fromship motions.

One or more examples described herein relate to 6DoF virtual realitycontent in which the user is at least substantially free to move in thevirtual space either by user-input through physically moving or, forexample, via a dedicated user interface (UI).

Augmented reality (AR) may use an AR display, such as glasses or gogglesor a virtual retinal display, to augment a view of the real world (suchas seen through the glasses or goggles) with computer generated content.An augmented reality apparatus, which may or may not include an ARdisplay, may provide for presentation of multimedia AR contentconfigured to be overlaid over the user's view of the real-world. Thus,a user of augmented reality may be able to view the real-worldenvironment around them, which is augmented or supplemented with contentprovided by the augmented reality apparatus, which may be overlaid ontheir view of the real world and/or aurally overlaid over an aural realworld scene they can hear. The content may comprise multimedia contentsuch as pictures, photographs, video, diagrams, textual information,aural content among others. Thus, while augmented reality may providefor direct viewing of the real world with the addition of computergenerated graphics and/or audio content, a user of virtual reality mayonly be able to see content presented on the VR display of the virtualreality apparatus substantially without direct viewing of the realworld.

One or more examples described herein relate to virtual reality or bothaugmented and virtual reality, so called mixed reality.

In one or more examples, a user may be able to view a vast array ofvirtual reality content. Given the immersive nature of VR content it maybe difficult for a user to browse or preview multiple instances of VRcontent. An instance of VR content may comprise a discrete data file orgroup of data files that define VR content or a predefined subsection ofVR content. Thus, similar to how images and/or videos are organised asdifferent data files in a computer system, instances of VR content maybe organised in a similar manner. Further, in one or more examples, auser may search a library of VR content using a search query and beprovided with plurality of results comprising separate instances of VRcontent that satisfy the search query. Reviewing those search resultsmay also be difficult and/or time consuming. For user-created VR contentthe scene or surroundings in which the VR content is captured may besimilar from instance to instance of VR content. For example, many ofthe instances of the VR content may comprise action occurring in theuser's garden or house. The subject of the VR content may also besimilar between instances of VR content, such as many instances of VRcontent featuring the user's cat. While these issues of similar subjector similar surroundings have been exemplified in relation to multipleinstances of user-created content, this may apply to multiple instancesof any VR content.

In one or more examples, the scale of 6DoF virtual reality content interms of the size of the virtual reality space created from the contentand the multitude of viewing locations and viewing directions from whichthe objects therein may be viewed may also present challenges relatingto providing a user with a summary of the VR content. This is becausefor 6DoF VR content, objects or occurrences may feature or happen atdifferent times and at different locations in the virtual reality space.Thus, while for a fixed point of view virtual reality experience, theplayback time point may be sufficient to reference when an object isfeatured or when an event occurred, for 6DoF content it may be necessaryto reference when during the virtual reality content and where in thevirtual reality space the objected is featured or the event occurs.

In one or more examples, an apparatus is disclosed that provides forpresentation to a user of virtual reality previews each relating to aninstance of virtual reality content, the VR previews presented in aVR-content-review-space to provide an immersive browsing or previewingexperience of instances of VR content.

FIG. 1 shows an example system 100 for presentation aVR-content-review-space to a user. The system 100 includes an exampleapparatus 101 for providing for display of the VR-content-review-spacewith one or more VR previews therein. The apparatus 101 may comprise orbe connected to a processor 101A and a memory 101B and may be configuredto execute computer program code. The apparatus 101 may have only oneprocessor 101A and one memory 101B but it will be appreciated that otherembodiments may utilise more than one processor and/or more than onememory (e.g. same or different processor/memory types). Further, theapparatus 101 may be an Application Specific Integrated Circuit (ASIC).

The processor may be a general purpose processor dedicated toexecuting/processing information received from other components, such asfrom a user-movement tracker 102 or content store 103, in accordancewith instructions stored in the form of computer program code in thememory. The output signalling generated by such operations of theprocessor is provided onwards to further components, such as to a VRdisplay device, such as VR headset 107.

The memory 101B (not necessarily a single memory unit) is a computerreadable medium (solid state memory in this example, but may be othertypes of memory such as a hard drive, ROM, RAM, Flash or the like) thatstores computer program code. This computer program code storesinstructions that are executable by the processor, when the program codeis run on the processor. The internal connections between the memory andthe processor can be understood to, in one or more example embodiments,provide an active coupling between the processor and the memory to allowthe processor to access the computer program code stored on the memory.

In this example the respective processors and memories are electricallyconnected to one another internally to allow for electricalcommunication between the respective components. In this example thecomponents are all located proximate to one another so as to be formedtogether as an ASIC, in other words, so as to be integrated together asa single chip/circuit that can be installed into an electronic device.In some examples one or more or all of the components may be locatedseparately from one another.

The apparatus 101, in this example, forms part of a virtual realityapparatus 104 for presenting visual imagery in virtual reality. In oneor more other examples, the apparatus 101 may form part of a mixedreality apparatus configured to present imagery as augmented reality orvirtual reality depending on the content. In one or more examples, theapparatus 100 may be independent of an AR or VR apparatus and mayprovide signalling to an ARNR/mixed reality apparatus. In this example,the processor 101A and memory 101B is shared by the VR apparatus 104 andthe apparatus 101, but in other examples, they may have their ownprocessors and/or memory.

The example of FIG. 2 does not exemplify the actions of the apparatus101 and is provided to illustrate possible challenges when presenting VRcontent. In the example shown in FIG. 2 four different instances of VRcontent are shown comprising a first instance of VR content 201, asecond instance of VR content 202, a third instance of VR content 203and a fourth instance of VR content 204. It will be appreciated that theVR space that may be generated from each instance of VR content may bespatially larger (e.g. much larger) than what is shown in FIG. 2 andtherefore FIG. 2, shows a spatial sub-section of VR space of eachinstance of VR content. Each of the instances of VR content 201-204 showthe same point of interest comprising a cat 205. The point of interestmay comprise any of an object, event or occurrence that features in saidVR content. Thus, the point of interest may comprise an object such as acat, a person or a car; an event such as birthday party, an athleticsrace or a fight; or an occurrence such as someone falling over, a windowbreaking or a person screaming. In the example of FIG. 2, the fourinstances of VR content may be the search results of a search query of“cat” of a user's VR content. While in this example, the search hasreturned four instances of the same cat, it will be appreciated thatsuch a search (or, more generally, in other embodiments) the display ofdifferent points of interest, i.e. different cats, that satisfy thesearch query.

It may be difficult for a user to distinguish between the first andsecond instance of VR content 201, 202, as the cat is shown in similarsurroundings. The fourth instance of VR content 204 may also bedifficult for a user to understand as all they are presented with is acat on a checked floor. For example, a user may be looking for VRcontent of their cat when they were at a particular location doing aparticular thing but it may be difficult to appreciate the context inwhich the point of interest is shown when previewing VR content.

Turning to the example FIG. 3, the same four instances of VR content201-204 are now provided for display in a VR-content-review-space 300based on context information. The VR-content-review-space is a virtualspace i.e. a computer generated three dimensional environment in whichthe VR previews can be displayed. In this example, the contextinformation is provided for each of the instances of VR content ratherthan one or more of them. The context information may define the extentof a virtual sub-volume of the virtual reality space that includes thepoint of interest so that, when previewing the instance of virtualreality content, a sufficient proportion or sub-volume of the VR spaceof the VR content is displayed. It will be appreciated, as mentionedabove, that the VR content may define a virtual reality space and thevirtual sub-volume may comprise a sub-volume of that virtual realityspace. A technical effect of providing for definition of such asub-volume, may be to provide a better preview of the VR content andthus an improved understanding of the virtual reality space around thepoint of interest. The sub-volume may thus define a volume less than thetotal spatial extent of the VR space but greater than a tight boundedspace around the point of interest.

Accordingly, in this example, the apparatus 101 or the VR apparatus 104under the control of the apparatus 101 may, based on a point of interest205 being identified in one or more instances of virtual reality content201-204 and based on context information for each instance 201-204 ofthe virtual reality content, the context information defining the extentof a virtual sub-volume (305 shown in FIG. 3) of the virtual realityspace that includes the point of interest 205; provide for display ofthe VR-content-review-space 300 to a user 306 comprising one or more VRpreviews of instances of VR content.

The one or more instances 201-204 of virtual reality content may eachcomprise visual imagery as well as audio to create a virtual realityspace in which the visual imagery is displayed and the audio presented.The context information may directly or indirectly define a sub-volumeof that VR space that features the point of interest.

It will be appreciated that the example VR-content-review-space 300shown in FIG. 3 is provided to illustrate what the user 306 may bepresented with through the VR headset 107. The image of the user 306 isshown in FIG. 3 for understanding to illustrate what the user 306 wouldsee around them in virtual or augmented reality. An image of the user306 may or may not be visible in the VR content review space.Accordingly, the sub-volumes of the instances of virtual reality contentmay be overlaid over the user's view of the real world in augmentedreality or the VR-content-review-space 300 may be presented in virtualreality.

The VR-content-review-space 300 thus comprises a virtual space in whicha VR preview 301-304 of each of the instances 201-204 of virtual realitycontent is displayed. The VR previews 301-304 are displayed at alocation spaced from a location of the point of view (marked as 307 and,in this example, located at a ground level) of the user 306. The spatialextent of each VR preview 301-304 is defined by the respectivesub-volume defined by the context information.

The VR previews 301-304 may each represent one of a plurality of searchresults of a search for “instances of VR content that include my cat”.

Accordingly, the context information allows for definition of thespatial extent of the VR preview for providing the user with anunderstanding of the virtual reality space around the point of interest205. Thus, with reference to the first VR preview 301 which relates tothe first instance of VR content 201, the context information hasprovided for inclusion in the sub-volume of the trees and the wall 308,which may enable the user to understand that the first instance of VRcontent is VR content showing the cat in the park. With reference to thesecond VR preview 302 which relates to the second instance of VR content202, the context information has provided for inclusion in thesub-volume of the letterbox 309, which may enable the user to understandthat the second instance of VR content is VR content showing the cat inthe user's front yard. With reference to the third VR preview 303 whichrelates to the third instance of VR content 203, the context informationhas provided for inclusion in the sub-volume of the ball, because theact of balancing on the ball may distinguish third instance of VRcontent from the first, second and fourth instances (and for example allother search results). With reference to the fourth VR preview 304 whichrelates to the fourth instance of VR content 204, the contextinformation has provided for inclusion in the sub-volume of the sofa310, which may enable the user to understand that the fourth instance ofVR content is VR content showing the cat in user's home.

The VR previews 301-304 may thus show sub-volumes that comprise anamount of the virtual reality space of their associated instance ofvirtual reality content to distinguish surroundings of the point ofinterest 205 in the sub-volume from surroundings of the point ofinterest in the sub-volume of any other of the one or more instances ofvirtual reality content. The context information may compriseinformation for defining the sub-volume for a plurality of differentobjects that features in the instance of VR content, the point ofinterest comprising one of those objects. Accordingly the contentinformation may be particular to an instance of VR content and/orspecific to objects in said instance of VR content.

How much of the surroundings to include in the sub-volume may bedetermined in various different ways. In one or more examples, thecontext information is configured to define the sub-volume such that itincludes at least one feature in the visual imagery of the VR content ata virtual location around said point of interest to provide anindication of the virtual surroundings of the point of interest. The atleast one feature may be termed an “associated nearby feature”. Thenearby feature may be “associated” in that it provides an understandingof the surroundings of the point of interest, i.e. context. Thus, ratherthan show the point of interest on its own, as in FIG. 2, the contextinformation may define a sub-volume that includes at least oneassociated nearby feature present in the VR content. Thus, for thesecond VR preview 302, that feature may comprise the letterbox 309. Thesub-volume may then be sized such that the VR preview shows the point ofinterest and is of dimensions to include the letterbox 309. In one ormore examples, the sub-volume may then be oriented such that the VRpreview shows the point of interest and the associated nearby feature,the letterbox 309, is not hidden by other objects. Thus, the sub-volumemay be one or more of sized or the visual imagery oriented therein toshow the point of interest and the associated nearby feature. The pointof interest may be centred in the sub-volume and the associated nearbyfeature may be substantially at an edge of the sub-volume. Theassociated nearby feature may be the nearest feature to the point ofinterest or may be predefined by the user or content creator.

Accordingly, in one or more examples, the context information may definethe sub-volume, in part, by reference to another feature 309 in the VRcontent.

In one or more other examples, the context information may define thedimensions of the sub-volume that includes the point of interest 205.Accordingly, for each point of interest 205, a sub-volume may be definedthat is sized sufficiently for the surroundings of the point of interestto be identifiable. The size of the sub-volume may change with elapsedtime through the VR content as the point of interest moves relative toother objects in the VR space.

In one or more other examples, the context information may define thesub-volume by reference to a virtual distance from the point of interestto the nearest other object or an associated nearby feature in thevisual imagery of the instance of virtual reality content. Thus, in oneor more examples, the distance between the point of interest 205 andanother object 309 may comprise the context information. The contextdistance of the information may then be used to define a sub-volume thatincludes the point of interest and regions up to the virtual distanceaway from the point of interest.

In one or more other examples, the context information may comprise anidentifier of at least one feature in the visual imagery of the instanceof virtual reality content, such as an identifier to identify theletterbox 309. The apparatus 101 or other apparatus may then determinethe dimensions of the sub-volume that includes the feature of theidentifier and the point of interest.

It will be appreciated from the above examples that the contextinformation may take various forms that may all provide for definitionof the sub-volume 305 to provide as a VR preview 302.

The context information may be generated at various different times. Forexample, it may be generated manually or automatically when the instanceof VR content was captured or at a time subsequent thereto. The contextinformation may be generated when the VR previews are generated based onanalysis, such as computer analysis, of the surroundings of the point ofinterest in the VR space.

Thus, in one or more examples, the context information may be predefinedand associated with the VR content 201-204. The context information maycomprise information to define the sub-volume associated with just onepoint of interest or a plurality of points of interest that feature insaid virtual reality content. Thus, the context information may comprisea list of points of interest objects that feature in the VR content andassociated nearby features near to the points of interest objects todefine the sub-volumes.

The context information may be generated automatically based on capturedVR content, such as when the VR-content-review-space is generated. Inone or more examples computer-based content analysis may be performed toidentify the location of the point of interest in said virtual realityspace of said instance of virtual reality content and define thesub-volume therearound to provide the user with an understanding of thevirtual reality space around the point of interest. The parameters onwhich the computer-based content analysis may operate may be to identifythe nearest object to the point of interest or identify the nearestunique object to the point of interest compared to the objectsidentified for other instances of VR content or other instances of VRcontent that are to be displayed in the VR-content-review-space 300.Other computer based pattern recognition and segmentation or deeplearning algorithms may be used that “understand” which nearby objectsmay be useful for understanding the context in which the point ofinterest is displayed.

Accordingly, in general, the content analysis may determine the size ofthe sub-volume of each VR preview based on a measure of howdistinguished each VR preview is from the other VR previews. Thus, ifcontent analysis operated based on the strategy that the nearest objectis included in the VR preview but the nearest object in all of the VRpreviews was a tree, the user may still find it difficult to distinguishbetween the instance of VR content. However, if the apparatus 101 isconfigured to ensure each VR preview is distinguishable from each otherpreviews presented to the user, such as in terms of the feature(s)included in the sub-volume, then the VR previews may be different to oneanother.

In one or more examples, the context information may be generated, atleast in part, from user-settings that specify the size of thesub-volume for the point of interest. Thus, a user 306 may specify thatthey wish to see a larger or smaller region of the VR space around aparticular point of interest 205 as the sub-volume.

The context information may therefore be specific to the point ofinterest featured in the instance of VR content. The context informationmay apply to only one point of interest or a class of points ofinterest. For example, the context information may relate only to aparticular cat 205 (e.g. the user's 306 cat) or may relate to cats ingeneral as a class. The context information may, in addition, bespecific to the surroundings of the point of interest in the respectiveinstance of VR content. Thus, for example, the cat appearing in acrowded scene with many other objects may provide for the contextinformation defining a smaller sub-volume as the many other objectsprovide sufficient context. To the contrary, the cat appearing in ascene sparse of other objects may provide for the context informationdefining a larger sub-volume in order for the context in which the pointof interest is present to be understood. The context information mayvary depending on an elapsed time through the VR content. Thus, thecontext information may thus be specific to the time at which the pointof interest features in the instance of VR content.

As shown in the example of FIG. 3, the VR preview comprises a spatialsub-volume, defined by the context information, of the whole VR spacethat may be generated from the instance of VR content. The VR previewmay comprise a fixed image, i.e. non-moving, of the point of interest inthe VR content. In such examples, the VR preview 301-304 appears as afreeze frame of the VR content. In other examples the VR preview 301-304may comprise a slideshow of still images of the point of interest. Inone or more examples, the VR preview may comprise moving imagery, i.e. avideo or 3-D video, of the point of interest as it appears in theinstance of VR content. The moving imagery may comprise moving imageryof temporal parts of the instance of VR content only or predominately attimes that feature the point of interest. In other examples the movingimagery may be from discontinuous times throughout the instance of VRcontent wherein only one or some of the parts feature the point ofinterest. In general, the VR preview may show a temporal subset of aperiod of time covered by the instance of VR content. The temporalsubset may, for example, comprise the times that the point of interestfeatures in the instance of VR content. In one or more examples, the VRpreview may comprise a combination of fixed imagery and moving imagery,sometimes known as a Cinemagraph.

FIG. 4 shows two examples 401 and 402 of the sub-volumes defined by thecontext information that form the second VR preview 302. The firstexample 401 shows a substantially spherical-shaped sub-volume. In one ormore examples, the context information may define the distance to theassociated nearby feature (the letterbox) and a sphere may be generatedusing that distance and the point of interest as a centre point. Thesecond example 402 shows a substantially cube-shaped or cuboid-shapedsub-volume. It will be appreciated that other shaped sub-volumes may beused to form the VR previews 301-304. Further, the cube or cuboidsub-volumes may have rounded edges and/or corners. In some examples, thesub-volumes are substantially the same shape and in other examples theymay be different shapes. In some examples, the sub-volumes aresubstantially sectorial-shaped sub-volumes. The example of FIG. 3 showscuboid-shaped sub-volumes of different aspect ratios. As will beappreciated, the third VR preview 303 comprises a sub-volume that issubstantially cube-shaped, while the second VR preview 302 comprises asub-volume that is substantially cuboid-shaped.

In some examples, the bounds of the sub-volume may be provided fordisplay and in other examples, the bounds may be hidden. FIG. 4 showsthe bounds of the sub-volume as a wire frame to clearly illustrate theshape of the sub-volume. The example of FIG. 3 does not show such a wireframe view.

The VR previews 301-304 in this example are configured to present thepoint of interest substantially at the centre of the sub-volume 401,402. However, in other examples, the point of interest may be offset toone side of the sub-volume, such as to include the associated nearbyfeature.

Typically, the ground level for the instances of VR content provides abound on the VR space. Thus, the VR content may not include imagery forunderground features. Placement of the point of interest at the centreof the sub-volume may apply in horizontally aligned x and y directionsonly and may or may not apply in a vertically aligned z direction.

In one or more examples, (i) the location of the ground level relativeto the point of interest in the instance of VR content and (ii) theposition in the sub-volume the apparatus 101 places the point ofinterest may define how much of the sub-volume contains imagery of theVR content. Thus, as shown in FIG. 4, substantially the lower half ofthe VR preview is absent of imagery of the instance of VR contentbecause it is below ground level. If the point of interest had a highelevation above ground level, such as if the cat 205 was in a tree, theground level may not be visible in the VR preview 301-304. Thepresentation of ground level in the VR previews 301-304 may beimportant, as will be described below. In one or more examples, theground level in the one or more VR previews is aligned with the groundlevel in the VR-content-review-space 300.

In the examples described herein the scale of the point of interest issubstantially equal between VR previews 301-304. The relative size ofeach of the VR previews relative to the other VR previews may thereforebe defined by the size of the virtual sub-volume defined by the contextinformation for each instance of VR content. Thus, the sub-volumes ofthe VR previews 301-304 are sized in accordance with the contextinformation rather than showing a “zoomed in” or “zoomed out” view oftheir associated VR space cropped to the shape of the sub-volume. Itwill be appreciated that the VR-content-review-space comprises a virtualthree-dimensional space and therefore the further the point of interestis away from the point of view of the user, the smaller it may appear.Accordingly, the scale of the point of interest may be substantiallyequal but the displayed size of the point of interest may be differentdepending on the distance from the point of view of the user 306. Inother examples, the scale of the point of interest and of the VR spacebetween VR previews 301-304 may differ.

6DoF VR allows an object appearing therein to be viewed from manydifferent or, in some examples, any angle. In one or more examples, thedirection from which the point of interest is viewed in the VR previewmay be determined based on the configuration of the point of interest.For example, the cat 205 may be presented such that the cat's face facesthe user 206. Each point of interest may be assigned a preferredorientation by the user or VR content creator. In one or more examples,the apparatus may determine the direction from which the point ofinterest is viewed in the VR preview based on the location of theassociated nearby feature relative to the point of interest and theshape of the sub-volume. For example, if the shape of the sub-volumewould result in the exclusion of the associated nearby feature from viewwhen the point of interest is oriented in a first orientation but notwhen oriented in second, different orientation, the apparatus 101 mayprovide for rotation of the VR space that forms the sub-volume to thesecond orientation to fit the shape of the VR preview. In one or moreexamples, the apparatus 101 may determine a preferred orientation forviewing of the point of interest. In one or more examples, the apparatusmay deviate from said preferred orientation based on the point ofinterest and the at least one associated nearby feature not beingvisible in said preferred orientation due to the shape of the VRpreview.

In one or more examples, the one or more VR previews 301-304 may beconsidered to comprise a three-dimensional window to view the sub-volumeof the virtual reality space. The sub-volume of the virtual realityspace of the associated VR content may be rotated. Accordingly, the usermay be presented with a rotating sub-volume of the virtual reality spacethrough the fixed (e.g. non-rotating) three-dimensional VR previewwindow. Depending on the size and/or shape of the window, rotation ofthe sub-volume of the VR space may cause the at least one associatednearby feature to fall outside the VR preview window for at least aportion of the rotation. The apparatus, in one or more examples, may beconfigured to prevent the associated nearby feature falling outside thewindow by one or more of temporarily growing the size or altering theshape of the VR preview window or by movement of the centre of rotationof the VR space in the VR preview window such that the at least onefeature and point of interest remain within the window of the VR previewthroughout the rotation of the sub-volume. In other embodiments, themodification of the VR preview window size, shape, or alignment may notbe done while the window is being rotated by the user. Rather themodification action, if necessary due to the associated nearby featurefalling outside the window, may be performed only once the usercompletes the rotation and the VR preview window thus achieves a reststate (without modification of its position or orientation by the user).

Thus, the one or more VR previews 301-304 may be provided for displaysuch that the VR previews comprise a three dimensional window throughwhich the sub-volumes viewed and wherein the VR previews are providedwith a substantially fixed orientation relative to the user 306 and thesub-volumes of virtual reality space and the point of interest displayedtherein are rotated.

A penalty function may be defined, upon which the apparatus selects oneof growing the size of the sub-volume such that at least the associatednearby feature in a preferred direction is visible, or rotating thesub-volume such that the at least one contextual object remains in thepart of the VR preview that is rendered for the user.

The apparatus 101 may provide for different layouts of the VR previews301-304 in the VR-content-review-space 300. In the example of FIG. 3 theplurality of VR previews 301-304 of instances of virtual reality content201-204 are each provided for display in the VR-content-review-space ata non-overlapping location that is spaced (by distance 311) from thepoint of view 307 of the user (or a floor level projection of it). Theuser 306 is therefore presented with the VR-content-review-space 300with the user placed at its centre and the VR previews 301-304 aroundthem. The VR previews 301-304 are arranged to surround the user 306,although in other examples, the VR previews may be arranged in apredetermined region of the VR-content-review-space 300, such as infront of the user and not behind the user 306.

The example of FIG. 5 shows the user 306 in a VR-content-review-space300. The left-hand image of FIG. 5 shows a region of theVR-content-review-space 300 in which VR previews may be positioned bythe apparatus 101. The right-hand image of FIG. 5 shows where in theVR-content-review-space 300 the apparatus 101 may place a plurality ofVR previews 501-505. Further, in this example, the VR previews 501-505are sector shaped and surround the user 306.

In the example of FIG. 5, the VR preview 501 and VR preview 502 areshown to partially overlap in region 506. Further, the VR preview 504and VR preview 505 are shown to partially overlap in region 507. The VRpreview 503 and adjacent VR previews 502, 504 do not overlap and arespaced from one another. In this example, the width or angular width 508of each of the sectors 501-505 may be defined by the context informationand the depth 509 may be predetermined. Alternatively, in otherexamples, the context information may define the angular width 508 anddefine the depth 509, as shown in the example of FIG. 7. In the exampleof FIG. 7, the point of interest, the cat 205, is presented at thecentre of the sub-volume of the VR preview. FIG. 7 further illustratesthe centering of the point of interest in the VR preview in terms ofboth width 508 and in terms of depth 509. Thus, in VR previews 701, 702,703 and 704 the point of interest may be of varying distances from theuser 306 as it is centred with respect to the depth of the VR previewsub volume. In one or more examples, the VR previews may be configuredsuch that the distance from the user's point of view to the point ofinterest may be the same in each preview whether or not two or more ofthe VR previews are provided with different depths 509. In one or moreexamples, the apparatus 101 may select the orientation with which the VRspace is presented to fit the point of interest (not shown in thisfigure) and the associated-nearby-feature into the shape of thesub-volume.

In general terms, the first VR preview 501 may be located to the side(or above or below) of the second VR preview 502 in theVR-content-review-space 300 from the point of view of the user 306 andthe sub-volume of the first VR preview 501 and sub-volume of the secondVR preview 502 may at least partially overlap one another at region 506.

The examples of FIG. 6 show the apparatus 101 having positioned the VRpreviews 601-608 in a sector arrangement around the user 306. In thisexample, one VR preview 601, for example, is arranged in front ofanother VR preview 605, for example, from the point of view of the user306. Thus, the VR previews are arranged in tiers. In this example the VRpreviews are arranged in two ring-shaped tiers. In the left-hand imageof FIG. 6 the VR previews 601-604 of the first tier are aligned in termsof their width with the VR previews 605-608 of the second tier. In someexamples, the apparatus 101 may rank the VR previews in terms ofrelevance to the user and arrange the more relevant VR previews in tierscloser to the user and less relevant VR previews in tiers further fromthe user. Thus, if the VR previews were the results of a search, themore relevant search results may be placed closer to the user 306 in theVR-content-review-space 300. In one or more examples, the VR previewsmay be ranked in terms of relevance to the user (such as based on asearch query or based on information provided to the apparatus) and theapparatus may be configured to position the VR previews in the contentreview space based on the ranking, the positioning taking account of oneor more of a tier in which the VR preview is placed and the viewingdirection of the user such that higher ranked VR previews are placed infront of the user's viewing direction and/or in a tier nearer the userand lower ranked VR previews are placed behind a user's viewingdirection and/or in a tier further from the user.

The right-hand image of FIG. 6 shows a similar example layout to theleft-hand image. However, in the right-hand image a further ninth VRpreview 609 is shown and the VR previews 601-604 of the first tier arenot aligned in terms of the edges of their widths with the VR previews605-609 of the second tier.

While the tiers in this example are ring shaped, the tiers may be of anyshape and may designate, more generally, a region of space in theVR-content-review space 300 in which VR previews may be positioned, eachtier defining a different continuous band of distances from the point ofview of the user at which the VR previews may be arranged.

It will be appreciated that in examples where the VR previews arearranged in tiers such that a first VR preview may be located in frontof a second VR preview from the point of view of the user, the apparatus101 may provide various ways to view the one or more VR previews of thesecond tier or subsequent tiers, if provided. In one or more examples,one or more of the VR previews of the first tier may be displayed withat least partial transparency to provide for viewing of the one or moreVR previews of a second tier. In some examples, the use of transparencymay not be required such as if the sub-volume of the VR preview does notinclude opaque objects such as walls. Thus, an outdoor scene may alreadybe transparent due to the absence of objects in the VR content that mayblock a view through the sub-volume. It is understood this applies toboth computer-generated content and to real-life captured content, whichincludes the necessary depth, and/or other volumetric information.

In one or more examples, the apparatus 101 may, based on user-input,make the “higher tier” VR preview 605 visible to the user by making the“lower tier” VR preview 601 transparent or removing it from display,such as temporarily removing it. In other examples, the location of the“lower tier” VR preview 601 may be shifted in theVR-content-review-space so that the “higher tier” VR preview 605 isvisible to the user 306.

The example of FIG. 8 shows an example layout of VR previews 801, 802,803, 804, 805 in which a first sector shaped VR preview 801 is providedfor display overlapping with a fifth sector shaped VR preview 805. Inparticular, the first VR preview 801 is provided for display within thesub-volume of the fifth VR preview 805.

In one or more examples, the apparatus may, based on sub-volume contentanalysis to identify a region of the sub-volume of a VR preview thatdoes not include the associated nearby feature, provide for display of afurther VR preview in an overlapping configuration wherein thesub-volumes overlap in the identified region. Thus, the apparatus 101may allow the VR previews to overlap in places where the features thatprovide context to the point of interest are not present to avoidcovering them or hindering their viewing by the user 306.

The example of FIG. 9 shows a further layout of VR previews in aVR-content-review-space 300. FIG. 9 illustrates the presentation of VRpreviews not just arranged relative to a two-dimensional plane butarranged along a spiral track that encircles the location 307 of thepoint of view of the user in the VR-content-review-space. A top view isshown in FIG. 9a and a perspective view is shown in FIG. 9b . Theapparatus may provide for display of a VR preview 901-904 at the heightof the user's point of view, similar to previous examples. The apparatus101, in response to a specific user input may provide for lowering ofthe spiral relative to the user such that the other VR previews 905become level with the user's point of view. The spiral may be rotated orspun to provide the effect of drawing the VR previews 905 down towardsthe user's line of sight. The spiral track may be provided to extendbelow the user 306 as well as above the user 306 to provide an oppositebrowsing direction. Alternatively, there may be two spirals extendingabove the user for example in opposite directions to provide the samefunctionality.

The example of FIG. 10 shows a further layout of theVR-content-review-space 300. In the example of FIG. 10 a plan view isshown. In this layout, the user 306 is partially surrounded by VRpreviews 1001, 1002, 1003, 1004, 1005 similar to the other examples in alimited region shown as dashed region 1020. The remaining region 1021 ofthe VR-content-review-space 300 includes further VR previews showncollectively as 1006 that extend into the distance.

This arrangement may be advantageous when there are many VR previews asVR previews in region 1020 or moved into region 1020 may be easilyselectable while the user will be aware of the many other VR previews inregion 1021. The user may not be able to select VR previews from theregion 1021 and may be required to move the VR previews, as if on acarousel, to the region 1020.

The VR-content-review-space 300 may provide a virtual three-dimensionalspace for a user 306 to review or preview different instances of VRcontent. The apparatus 101 may further provide for user selection of oneof the VR previews to perform functionality related to the selected VRpreview.

The user selection may comprise the user selecting one of the VRpreviews using an interface such as a smartphone or other input device.Alternatively, the apparatus may determine a user selection based onmovement of the user in the VR-content-review-space 300. In one or moreexamples, the user-movement tracker 102 may provide data indicative ofreal-world physical user movement to the apparatus 101 and based on thedata the apparatus 101 may identify a user selection.

Thus, in one or more examples, the user may step into one of the VRpreviews to select it. As the VR-content-review-space 300 may comprise a6DoF virtual reality space or an augmented reality space, the movementof the user around said space may be intuitive to the user 306.

The apparatus 101, based on a user input to move their point of view 307in the VR-content-review-space 300 to a position within the sub-volumeof a particular one of the VR previews 301-304, may provide for avariety of actions.

For example, if the VR previews comprise non-moving imagery, i.e. stillimagery, moving into the VR preview may cause the apparatus 101 toprovide for presentation of at least a temporal sub-section of theinstance of VR content associated with the particular VR preview, atleast a portion of the temporal sub-section featuring the point ofinterest. Thus, moving imagery may be provided of the VR content thatfeatures the point of interest. The temporal sub-section may beconsidered as a summary or highlights of the instance of VR content. Atleast a portion of the highlights may feature the point of interest.

Other functionality that may be provided on user selection of one of theVR previews includes presentation of the instance of VR contentassociated with the selected VR preview in virtual reality. Thus, theapparatus may cease presentation of the VR-content-review-space 300 withthe sub-volumes of the VR spaces therein, and provide for display of theVR space of the instance of VR content that is associated with theselected VR preview. Accordingly, the apparatus 101 may provide for atransition from the VR-content-review-space to the VR space of theselected VR content, as if the user stepped into the world representedby the selected VR preview. The user may be provided with substantiallythe same location in the VR space as shown in the VR preview. Withreference to FIG. 3, the user may step into the second VR preview 302.The second VR preview 302 is associated with the second instance of VRcontent 202. The second instance of VR content 202 includes visualimagery from which a VR space can be generated. Thus, on user selectionof the second VR preview 302, the apparatus may provide for display ofthe VR space with visual imagery from the second instance of VR contentand thereby present the imagery of the user's front yard surroundingthem.

Other functionality that may be provided on user selection of one of theVR previews includes presentation of a larger volume of the virtualreality space than that defined by the sub-volume. Thus, the sub-volumemay show at least an associated-nearby-feature in order for the user tounderstand the context of the VR content, but the user selection mayprovide for display of a larger volume of the VR space generated fromthe selected instance of VR content (via selection of the associated VRpreview). Similarly, whatever audio may be presented when displaying theVR content-review-space 300 may be replaced by the audio related to theselected instance of the VR content.

Other functionality that may be provided on user selection of one of theVR previews includes removal from display of the VR previews other thanthe selected VR preview. Thus, based on user selection of the second VRpreview 302, the first, third and fourth VR previews 301, 303, 304 maybe removed from display.

It will be appreciated that one, some or all of the above functionalitymentioned above may be provided with appropriate user input to identifythe functionality the user wishes to actuate.

When the user steps or moves their point of view into one of the VRpreviews 301-304 they may be placed at a ground level defined in the VRspace of the instance of VR content they step into. Thus, it may beadvantageous to provide the ground level of the VR space shown in the VRpreview at the same level as ground level in the VR-content-review-space300. Otherwise when the user steps into the VR preview they may stepinto “mid-air” or an underground region of the VR space. Based on userselection of a VR preview in which the ground level is not visible, forexample when the point of interest happens to be some distance from theground level, the apparatus may provide for display of the selected VRpreview such that the ground level becomes visible to the user.Accordingly, if the apparatus 101 were then to present the VR space ofthe selected VR preview, the user 306 understands where they havestepped into relative to the point of interest.

As an example, the cat 205 may be shown in a VR preview at the top of atall tree and the sub-volume may not be sized sufficiently to showground level. When the user makes a user selection of the VR preview,the apparatus 101 may animate the movement or expansion of the VRpreview or the volume of the VR space shown in the VR preview such thatthe ground level becomes visible at the base of the tree. The user 306may then understand that when stepping into the VR preview to select theVR content of the cat in the tall tree is shown in preference to theVR-content-review-space, they are located at the base of the tall tree.

The action of stepping into different VR spaces, represented by the VRpreviews from the VR-content-review-space may provide an effective wayof selecting the VR content for the user to become immersed in. It willbe appreciated that other ways of selecting the VR previews may be used.

FIG. 11 shows a flow diagram illustrating the steps of,

-   -   based on 1101 a point of interest being identified in one or        more instances of virtual reality content, the one or more        instances of virtual reality content each comprising at least        visual imagery to provide a virtual reality space in which the        visual imagery is displayed; and based on context information        for one or more of or each instance of the virtual reality        content, the context information defining the extent of a        virtual sub-volume of the virtual reality space that includes        the point of interest;    -   providing 1102 for display in one of virtual reality and        augmented reality of a VR-content-review-space to a user, the        VR-content-review-space comprising a virtual space in which a VR        preview of the at least one instance of virtual reality content        is displayed at a location spaced from a point of view of the        user, each VR preview comprising the respective sub-volume        defined by the context information for providing the user with        an view or understanding of the virtual reality space around the        point of interest.

FIG. 12 illustrates schematically a computer/processor readable medium1200 providing a program according to an example. In this example, thecomputer/processor readable medium is a disc such as a digital versatiledisc (DVD) or a compact disc (CD). In some examples, the computerreadable medium may be any medium that has been programmed in such a wayas to carry out an inventive function. The computer program code may bedistributed between the multiple memories of the same type, or multiplememories of a different type, such as ROM, RAM, flash, hard disk, solidstate, etc.

User inputs may be gestures which comprise one or more of a tap, aswipe, a slide, a press, a hold, a rotate gesture, a static hovergesture proximal to the user interface of the device, a moving hovergesture proximal to the device, bending at least part of the device,squeezing at least part of the device, a multi-finger gesture, tiltingthe device, or flipping a control device. Further the gestures may beany free space user gesture using the user's body, such as their arms,or a stylus or other element suitable for performing free space usergestures.

The apparatus shown in the above examples may be a portable electronicdevice, a laptop computer, a mobile phone, a Smartphone, a tabletcomputer, a personal digital assistant, a digital camera, a smartwatch,smart eyewear, a pen based computer, a non-portable electronic device, adesktop computer, a monitor, a smart TV, a server, a wearable apparatus,a virtual reality apparatus, or a module/circuitry for one or more ofthe same.

Any mentioned apparatus and/or other features of particular mentionedapparatus may be provided by apparatus arranged such that they becomeconfigured to carry out the desired operations only when enabled, e.g.switched on, or the like. In such cases, they may not necessarily havethe appropriate software loaded into the active memory in thenon-enabled (e.g. switched off state) and only load the appropriatesoftware in the enabled (e.g. on state). The apparatus may comprisehardware circuitry and/or firmware. The apparatus may comprise softwareloaded onto memory. Such software/computer programs may be recorded onthe same memory/processor/functional units and/or on one or morememories/processors/functional units.

In some examples, a particular mentioned apparatus may be pre-programmedwith the appropriate software to carry out desired operations, andwherein the appropriate software can be enabled for use by a userdownloading a “key”, for example, to unlock/enable the software and itsassociated functionality. Advantages associated with such examples caninclude a reduced requirement to download data when furtherfunctionality is required for a device, and this can be useful inexamples where a device is perceived to have sufficient capacity tostore such pre-programmed software for functionality that may not beenabled by a user.

Any mentioned apparatus/circuitry/elements/processor may have otherfunctions in addition to the mentioned functions, and that thesefunctions may be performed by the sameapparatus/circuitry/elements/processor. One or more disclosed aspectsmay encompass the electronic distribution of associated computerprograms and computer programs (which may be source/transport encoded)recorded on an appropriate carrier (e.g. memory, signal).

Any “computer” described herein can comprise a collection of one or moreindividual processors/processing elements that may or may not be locatedon the same circuit board, or the same region/position of a circuitboard or even the same device. In some examples one or more of anymentioned processors may be distributed over a plurality of devices. Thesame or different processor/processing elements may perform one or morefunctions described herein.

The term “signalling” may refer to one or more signals transmitted as aseries of transmitted and/or received electrical/optical signals. Theseries of signals may comprise one, two, three, four or even moreindividual signal components or distinct signals to make up saidsignalling. Some or all of these individual signals may betransmitted/received by wireless or wired communication simultaneously,in sequence, and/or such that they temporally overlap one another.

With reference to any discussion of any mentioned computer and/orprocessor and memory (e.g. including ROM, CD-ROM etc), these maycomprise a computer processor, Application Specific Integrated Circuit(ASIC), field-programmable gate array (FPGA), and/or other hardwarecomponents that have been programmed in such a way to carry out theinventive function.

The applicant hereby discloses in isolation each individual featuredescribed herein and any combination of two or more such features, tothe extent that such features or combinations are capable of beingcarried out based on the present specification as a whole, in the lightof the common general knowledge of a person skilled in the art,irrespective of whether such features or combinations of features solveany problems disclosed herein, and without limitation to the scope ofthe claims. The applicant indicates that the disclosed aspects/examplesmay consist of any such individual feature or combination of features.In view of the foregoing description it will be evident to a personskilled in the art that various modifications may be made within thescope of the disclosure.

While there have been shown and described and pointed out fundamentalnovel features as applied to examples thereof, it will be understoodthat various omissions and substitutions and changes in the form anddetails of the devices and methods described may be made by thoseskilled in the art without departing from the scope of the disclosure.For example, it is expressly intended that all combinations of thoseelements and/or method steps which perform substantially the samefunction in substantially the same way to achieve the same results arewithin the scope of the disclosure. Moreover, it should be recognizedthat structures and/or elements and/or method steps shown and/ordescribed in connection with any disclosed form or examples may beincorporated in any other disclosed or described or suggested form orexample as a general matter of design choice. Furthermore, in the claimsmeans-plus-function clauses are intended to cover the structuresdescribed herein as performing the recited function and not onlystructural equivalents, but also equivalent structures. Thus although anail and a screw may not be structural equivalents in that a nailemploys a cylindrical surface to secure wooden parts together, whereas ascrew employs a helical surface, in the environment of fastening woodenparts, a nail and a screw may be equivalent structures.

The invention claimed is:
 1. An apparatus comprising at least oneprocessor; and at least one memory including computer program code; theat least one memory and the computer program code configured to, withthe at least one processor, cause the apparatus at least to perform:based on a point of interest being identified in one or more instancesof virtual reality content, the one or more instances of virtual realitycontent comprising at least visual imagery and data to provide a virtualreality space in which the visual imagery is displayed; and based oncontext information for at least one of the one or more instances of thevirtual reality content, the context information defining the extent ofa virtual sub-volume of the virtual reality space that includes thepoint of interest; provide for display of avirtual-reality-content-review-space to a user, thevirtual-reality-content-review-space comprising a virtual space in whicha virtual reality preview of the one or more instances of virtualreality content is displayed at a location spaced from a point of viewof the user, the one or more virtual reality previews comprising therespective sub-volume defined by the context information for providingthe user with a view of the virtual reality space around the point ofinterest.
 2. The apparatus of claim 1, wherein the sub-volume comprisesan amount of the virtual reality space of one or more instances ofvirtual reality content to distinguish surroundings of the point ofinterest in the sub-volume from surroundings of the point of interest inthe sub-volume of any other of the one or more instances of virtualreality content.
 3. The apparatus of claim 1, wherein the contextinformation is one or more of: predefined and associated with thevirtual reality content, the context information providing informationto define the sub-volume associated with one or more points of interestthat feature in said virtual reality content; generated from computercontent analysis configured to identify the location of the point ofinterest in said virtual reality space of said instance of virtualreality content and define the sub-volume therearound to provide theuser with an understanding of the virtual reality space around the pointof interest; or generated, at least in part, from user-settings thatspecify the size of the sub-volume for the point of interest.
 4. Theapparatus of claim 1, wherein the context information is specific to thepoint of interest and to its surroundings in the respective instance ofvirtual reality content.
 5. The apparatus of claim 1, wherein thecontext information defines an associated nearby feature in the virtualreality content, the sub-volume defined such that it includes the pointof interest and the associated nearby feature, the associated nearbyfeature comprising a predetermined feature in the visual imagery of theinstance of virtual reality content at a virtual location around saidpoint of interest to provide an indication of the virtual surroundingsof the point of interest.
 6. The apparatus of claim 1, wherein the oneor more instances of virtual reality content comprises search results ofa search query, the search query performed on a plurality of instancesof virtual reality content that include the one or more instances ofvirtual reality content, the point of interest comprising the subject ofa search query from which said search results were generated.
 7. Theapparatus of claim 1, wherein a plurality of virtual reality previews ofinstances of virtual reality content are provided for display in thevirtual-reality-content-review-space, the virtual reality previewsdisplayed at a location spaced from a point of view of the user and atleast partially surrounding the point of view of the user.
 8. Theapparatus of claim 1, wherein at least two virtual reality previews areprovided for display, and wherein the relative size of each of the twoor more virtual reality previews relative to other virtual realitypreviews provided for display is defined by the size of the virtualsub-volume defined by the context information for two or more instancesof virtual reality content.
 9. The apparatus of claim 1, wherein atleast two virtual reality previews are provided for display, a firstvirtual reality preview and a second virtual reality preview and whereinone or more of: the first virtual reality preview is located to the sideof the second virtual reality preview in thevirtual-reality-content-review-space from the point of view of the userand the virtual sub-volume of the first virtual reality preview andvirtual sub-volume of the second virtual reality preview overlap oneanother; the virtual sub-volume of the first virtual reality preview andvirtual sub-volume of the second virtual reality preview arenon-overlapping; the first virtual reality preview is located in frontof the second virtual reality preview in thevirtual-reality-content-review-space from the point of view of the userand the first virtual reality preview is displayed with at least partialtransparency to provide for viewing of the second virtual realitypreview through the first virtual reality preview; or the first virtualreality preview is located in front of the second virtual realitypreview in the virtual-reality-content-review-space from the point ofview of the user thereby hiding the second virtual reality preview fromview, wherein based on user-input the second virtual reality preview ismade visible to the user.
 10. The apparatus of claim 1, wherein based ona user input to move their point of view in thevirtual-reality-content-review-space to a position within the sub-volumeof a particular one of the virtual reality previews, provide for one ormore of: presentation of at least a temporal sub-section of the instanceof virtual reality content associated with the particular virtualreality preview, at least a portion of the temporal section featuringthe point of interest; presentation of the instance of virtual realitycontent associated with the particular virtual reality preview invirtual reality; presentation of a larger volume of the virtual realityspace that that defined by the sub-volume; or removal from display ofthe virtual reality previews other than the particular virtual realitypreview.
 11. The apparatus of claim 1, wherein the one or more virtualreality previews comprise one or more of: substantially cuboid-shapedsub-volumes; substantially spherical-shaped sub-volumes; orsubstantially sectorial-shaped sub-volumes.
 12. The apparatus of claim1, wherein the one or more virtual reality previews are provided fordisplay such that one or more virtual reality preview comprises a windowthrough which the sub-volumes are viewed and wherein the virtual realitypreviews are provided with a substantially fixed orientation relative tothe user and the sub-volumes of virtual reality space and the point ofinterest therein are rotated.
 13. The apparatus of claim 1, wherein theone or more virtual reality previews are provided for display in one ormore of the following configurations: in a plane surrounding the pointof view of the user; in at least two planes, a first of the planesarranged substantially horizontally and surrounding the point of view ofthe user and the second of the planes arranged substantiallyhorizontally and above or below the point of view of the user, spacedfrom the first plane; in a plurality of sectors that converge at thepoint of view of the user; in a first tier comprising a plurality ofsectors that converge at the point of view of the user and a second tiercomprising a plurality of sectors arranged in a ring that issubstantially centered at the point of view of the user; or at spacedpoints along a spiral that spirals around the point of view of the user.14. A method, the method comprising based on a point of interest beingidentified in one or more instances of virtual reality content, the oneor more instances of virtual reality content comprising at least visualimagery to provide a virtual reality space in which the visual imageryis displayed; and based on context information for at least one of theone or more instances of the virtual reality content, the contextinformation defining the extent of a virtual sub-volume of the virtualreality space that includes the point of interest; providing for displayof a virtual-reality-content-review-space to a user, thevirtual-reality-content-review-space comprising a virtual space in whicha virtual reality preview of the at least one instance of virtualreality content is displayed at a location spaced from a point of viewof the user, the one or more virtual reality preview comprising therespective sub-volume defined by the context information for providingthe user with a view of the virtual reality space around the point ofinterest.
 15. The method of claim 14, wherein the sub-volume comprisesan amount of the virtual reality space of one or more instances ofvirtual reality content to distinguish surroundings of the point ofinterest in the sub-volume from surroundings of the point of interest inthe sub-volume of any other of the one or more instances of virtualreality content.
 16. The method of claim 14, wherein the contextinformation is one or more of: predefined and associated with thevirtual reality content, the context information providing informationto define the sub-volume associated with one or more points of interestthat feature in said virtual reality content; generated from computercontent analysis configured to identify the location of the point ofinterest in said virtual reality space of said instances of virtualreality content and define the sub-volume therearound to provide theuser with an understanding of the virtual reality space around the pointof interest; or generated, at least in part, from user-settings thatspecify the size of the sub-volume for the point of interest.
 17. Themethod of claim 14, wherein the context information is specific to thepoint of interest and to its surroundings in the respective instances ofvirtual reality content.
 18. The method of claim 14, wherein the contextinformation defines an associated nearby feature in the virtual realitycontent, the sub-volume defined such that it includes the point ofinterest and the associated nearby feature, the associated nearbyfeature comprising a predetermined feature in the visual imagery of theinstance of virtual reality content at a virtual location around saidpoint of interest to provide an indication of the virtual surroundingsof the point of interest.
 19. The method of claim 14, wherein the one ormore instances of virtual reality content comprises search results of asearch query, the search query performed on a plurality of instances ofvirtual reality content that include the one or more instances ofvirtual reality content, the point of interest comprising the subject ofa search query from which said search results were generated.
 20. Anon-transitory computer readable medium comprising program instructionsstored thereon for performing at least the following: based on a pointof interest being identified in one or more instances of virtual realitycontent, the one or more instances of virtual reality content comprisingat least visual imagery and data to provide a virtual reality space inwhich the visual imagery is displayed; and based on context informationfor at least one of the one or more instances of the virtual realitycontent, the context information defining the extent of a virtualsub-volume of the virtual reality space that includes the point ofinterest; provide for display of a virtual-reality-content-review-spaceto a user, the virtual-reality-content-review-space comprising a virtualspace in which a virtual reality preview of the one or more instances ofvirtual reality content is displayed at a location spaced from a pointof view of the user, the one or more virtual reality previews comprisingthe respective sub-volume defined by the context information forproviding the user with a view of the virtual reality space around thepoint of interest.